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Abstract 

This  paper  examines  the  problem  of  automatic  explanation  of  reasoning,  especially  as  it  relates  to 
expert  systems.  By  explanation  \nq  mean  the  ability  of  a  program  to  discuss  what  it  is  doing  in  some 
understandable  way.  We  first  present  a  general  framework  in  which  to  view  explanation  and  review 
some  of  the  research  done  in  this  area.  We  then  focus  on  the  explanation  system  for  NEOMYCIN,  a 
medical  consultation  program.  A  consultation  program  interactively  helps  a  user  to  solve  a  problem. 
Our  goal  is  to  have  NEOMYCIN  explain  its  problem-solving  strategies.  An  explanation  of  strategy 
describes  the  plan  the  program  is  using  to  reach  a  solution.  Such  an  explanation  is  usually  concrete, 
referring  to  aspects  of  the  current  problem  situation.  Abstract  explanations  articulate  a  general 
principle,  which  can  be  applied  in  different  situations;  such  explanations  are  useful  in  teaching  and  in 
explaining  by  analogy.  We  describe  the  aspects  of  NEOMYCIN  that  make  abstract  strategic 
explanations  possible-the  representation  of  strategic  knowledge  explicitly  and  separately  from 
domain  knowledge-and  demonstrate  how  this  representation  can  be  used  to  getrerate  explanations. 

1.  Introduction 

The  ability  to  explain  reasoning  is  usually  considered  an  important  component  of  any  expert 
system.  An  explanation  facility  is  useful  on  several  levels:  it  can  help  knowledge  engineers  to  debug 
and  test  the  system  during  development,  assure  the  sophisticated  user  that  the  system's  knowledge 
and  reasoning  process  is  appropriate,  and  instruct  the  naive  user  or  student  about  the  knowledge  in 
the  system.  (Scott  et  al.,  1977)  (Davis,  1976)  (Swartout,  1981a) 

The  problems  in  producing  explanations  can  be  viewed  in  a  framework  of  three  major 
considerations:  epistemologic  issues,  user  modelling,  and  rhetoric.  This  section  discusses  what  we 
mean  by  each  of  these  and  reviews  work  done  in  each  area. 

1.1 .  Epistemologic  issues 

The  foundation  of  any  explanation  is  a  model  of  the  knowledge  and  reasoning  process  to  be 
explained.  The  explanation  work  that  we  characterize  as  epistemological  is  concerned  with  the 
knowledge  that  is  required  to  solve  a  problem  and  the  aspects  of  problem-solving  behavior  that  need 
to  be  explained.  In  attempting  to  emulate  human  problem-solving  activities  (such  as  electronic 
trouble-shooting  (Brown  et  al.,  1982)),  researchers  found  that  existing  models  of  human  reasoning 
were  too  limited  to  support  robust  problem-solving  and  explanation.  Thus  one  key  aspect  of  research 
in  this  area  is  tfie  study  and  formalization  of  the  reasoning  process  in  terms  of  the  structure  of 
knowledge  and  how  it  is  manipulated.  For  example,  in  examining  causal  rationalizations  and 
explanations,  deKleer  and  Brown  (doKleer  &  Brown,  1982)  discovered  the  problems  of  modelling 
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causal  processes  precisely  so  they  are  powerful  enough  to  solve  problems  people  can  solve,  as  well 
as  intuitive  enough  for  people  to  understand.  Similar  studies  are  underway  for  physics  problem¬ 
solving  (Chi  et  al.,  1981)  and  medical  diagnosis  (Patii  et  al.,  1981 ),  (Pople,  1982). 

Another  aspect  of  this  work  is  the  design  of  a  representation  language  for  formalizing  a  model  of 
reasoning  in  a  computer  system.  Shortliffe  (Shortliffe,  1976)  and  Davis  (Davis,  1976)  use  a  simple 
framework  of  goals  and  inference  rules  to  direct  a  medical  consultation;  the  translation  of  these  rules 
constitutes  the  explanation  of  the  inference  procedure.  Clancey  (Clancey,  1981)  explores  the  issue  of 
representing  each  type  of  knowledge  separately  and  explicitly  in  order  to  convey  it  clearly  to  a 
student.  Swartout  (Swartout,  1981b)  uses  domain  principles  and  constraints  to  produce  a 
"refinement  structure"  that  encodes  the  reasoning  process  used  in  constructing  the  consultation 
program.  In  all  cases,  the  task  in  designing  these  systems  is  to  represent  knowledge  and  reasoning  in 
a  well-structured  formalism  that  can  be  used  to  solve  problems  (perhaps  in  compiled  form  as  in 
Swartout's  system)  and  then  examined  to  justify  the  program’s  actions. 

1.2.  User  model 

Given  an  idea  of  the  knowledge  needed  to  solve  the  problem  and  a  representational  framework,  a 
model  of  the  user  can  be  used  as  a  step  in  determining  what  needs  to  be  explained  to  a  particular 
person.  The  basic  idea  is  to  generate  an  explanation  that  takes  into  account  user  knowledge  and 
preferences,  often  based  on  previous  user  interactions  and  general  a  priori  models  of  expertise 
levels.  The  modelling  component  produces  this  picture  of  the  user. 

For  example,  Genesereth  (Genesereth,  1982)  takes  the  approach  of  constructing  a  user  plan  in  the 
course  of  an  interaction  to  determine  a  user’s  assumptions  about  a  complex  consultation  program,  in 
ONCXX^IN,  Langlotz  (Langlotz  &  Shortliffe,  1983)  is  able  to  highlight  significant  differences  between 
the  user’s  and  system’s  solutions  by  first  asking  the  user  to  solve  the  problem,  a  common  approach  in 
Intelligent  Tutoring  Systems.  In  GUIDON,  (Clancey,  1979)  uses  an  "overlay  model",  in  which  the 
student’s  knowledge  is  modelled  as  a  subset  of  what  the  expert  knows.  In  BUGGY,  Brown  and  Burton 
(Brown  &  Burton,  1980)  compiled  an  exhaustive  representation  of  errors  in  arithmetic  to  identify  a 
student’s  addition  and  subtraction  "bugs". 

1.3.  Rhetoric 

Once  the  content  of  an  explanation  has  been  determined,  there  is  the  question  of  how  to  convey 
this  information  to  tl;e  user.  Rhetoric  is  concerned  with  stating  the  explanation  so  that  it  will  be 
understandable.  It  is  here  that  psychological  considerations  (for  example,  the  need  for  occasional 
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review  to  respect  human  limitations  for  assimilating  new  information)  are  also  examined.  In 
STEAMER  (Williams  et  al..  1981),  Stevens  explores  the  medium  of  explanation  by  using  a  simulation 
of  a  physical  device,  a  steam  propulsion  plant,  to  produce  graphic  explanations  supplemented  with 
text.  Choosing  the  appropriate  level  of  detail  (that  is,  pruning  the  internally  generated  explanation) 
has  been  considered  by  Swartout  (Swartout,  I98la)  and  Wallis  and  Shortliffe  (Wallis  &  Shortliffe, 
1982). 

Explanations,  like  al!  communication,  have  structural  components.  For  example,  BLAH  (Weiner, 
1980)  structures  explanations  so  that  they  do  not  appear  too  complex,  taking  such  things  as 
embedded  explanations  and  focus  of  attention  into  account.  For  TEXT,  McKeown  (McKeown,  1982) 
examined  rhetorical  techniques  to  create  schemas  that  encode  aspects  of  discourse  structure.  The 
system  is  thus  able  to  describe  the  same  information  in  different  ways  for  different  discourse 
purposes.  In  GUIDON,  Clancey  (Clancey,  1979)  developed  a  set  of  discourse  procedures  for  case 
method  tutorial  interactions.  The  most  trivial  form  of  structure  is  syntax,  a  problem  all  natural 
language  generators  must  consider.  At  the  opposite  extreme  some  programs  can  produce 
multiparagraph  text  (Mann  et  al.,  1981). 


2.  Motivation  for  strategic  explanations  in  NEOMYCIN 

2.1 .  NEOMYCIN  and  strategies 

The  purpose  of  NEOMYCIN  is  to  develop  a  knowledge  base  that  facilitates  recognizing  and 
explaining  diagnostic  strategies  (Clancey,  1981).  In  terms  of  our  framework  for  explanation,  this  is  an 
epistemological  investigation.  The  approach  has  been  to  model  human  reasoning,  representing 
control  knowledge  (the  diagnostic  procedure)  explicitly.  By  explicit  we  mean  that  the  control 
knowledge  is  stated  abstractly  in  rules,  rather  than  embedded  in  application-specific  code,  and  that 
the  control  rules  are  separate  from  the  domain  rules^  .  In  contrast  to  Davis’s  use  of  metarules  for 
refining  the  invocation  of  base-level  rules  (Davis,  1980),  NEOMYCIN’S  metarules  choose  among  lines 
of  reasoning,  as  well  as  among  individual  productions.  Thus  the  metarules  constitute  a  strategy  in 
NEOMYCIN’S  problem  area  of  medical  diagnosis. 

A  strategy  is  "a  careful  plan  or  method,  especially  for  achieving  an  end."  To  explain  is  "to  make 
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See  (Clancey,  1983a)  lor  discussion  of  how  diagnostic  procedures  can  be  captured  by  rules  and  still  not  be  explicit. 


clear  or  plain;  to  give  the  reason  for  or  cause  of."*  Thus  in  a  strategic  explanation  we  are  trying  to 
make  clear  the  plans  and  methods  used  in  reaching  a  goal,  in  NEOMYCIN'S  case,  the  diagnosis  of  a 
medical  problem.  One  could  imagine  explaining  an  action  in  at  least  two  ways.  In  the  first,  the 
specifics  of  the  situation  are  cited,  with  the  strategy  remaining  relatively  implicit.  For  example,  "I’m 
asking  whether  the  patient  is  receiving  any  medications  in  order  to  determine  if  she’s  receiving 
penicillin.”  In  the  second  approach,  the  underlying  strategy  is  made  explicit;  "I’m  asking  whether  the 
patient  is  receiving  any  medications  because  I’m  interested  in  determining  whether  she’s  receiving 
penicillin.  /  ask  a  general  question  before  a  specific  one  when  possible. "  This  latter  example  is  the 
kind  of  strategic  explanation  we  want  to  generate.  The  general  approach  to  solving  the  problem  is 
mentioned,  as  well  as  the  action  taken  in  a  particular  situation.  Explanations  of  this  type  allow  the 
listener  to  see  the  larger  problem-solving  approach  and  thus  to  examine,  and  perhaps  learn,  the 
strategy  being  employed. 

Our  work  is  based  on  the  hypothesis  that  an  ’understander’  must  have  an  idea  of  the  problem¬ 
solving  process,  as  well  as  domain  knowledge,  in  order  to  understand  the  solution  or  solve  the 
problem  himself  (Brown  et  al.,  1978).  Specifically,  research  in  medical  education  (Elstein  et  al.,  1978), 
(Benbassat  &  Schiffman,  1976)  suggests  that  we  state  heuristics  for  students,  teaching  them  explicitly 
how  to  acquire  data  and  form  diagnostic  hypotheses.  Other  Al  programs  have  illustrated  the 
importance  of  strategies  in  explanations.  SHRDLU  (Winograd,  1972)  is  an  early  program  that 
incorporates  history  keeping  to  provide  WHY/HOW  explanations  of  procedures  used  by  a  ’robot'  in  a 
simulated  BLOCKSWORLD  environment.  The  procedures  of  this  robot  are  specific  to  the 
environment;  consequently,  abstract  explanations  such  as  "I  moved  the  red  block  to  achieve 
preconditions  of  a  higher  goal”  are  not  possible.  CENTAUR  (Aikins,  1980),  another  medical 
consultation  system,  explains  its  actions  in  terms  of  domain -specific  operations  and  diagnostic 
prototypes.  Swartout’s  XPLAIN  program  (Swartout,  1981b)  refers  to  domain  principles-general  rules 
and  constraints  about  the  domain-in  its  explanations,  in  each  of  these  programs,  abstract  principles 
have  been  instantiated  and  represented  in  problem-specific  terms. 

NEOMYCIN  generates  strategic  explanations  from  an  abstract  representation  of  strategy.  In 
contrast  with  other  approaches,  this  strategic  knowledge  is  completely  separate  from  the  domain 
knowledge.  This  general  strategy  is  instantiated  dynamically  as  the  consultation  runs.  Thus  when  the 
program  discusses  the  problem  solution,  it  is  able  to  state  a  general  approach,  as  well  as  how  it 
applies  in  concrete  terms. 


^Webster's  New  Collegiate  Dictionary 
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2.2.  MYCIN’s  explanation  capability 

MYCIN  is  a  rule-based  medical  consultation  system  designed,  in  part,  so  that  it  could  explain  its 
reasoning  to  a  user.  A  consultation  is  run  by  backchaining  through  the  applicable  rules,  asking 
questions  when  necessary.  The  reasoning  employed  by  the  system  is  explained  in  terms  of  this  goal 
chain.  There  are  two  basic  explanation  commands:  WHY  is  used  to  ascend  the  chain,  discussing 
subsequently  higher  sub-goals,  while  HOW  d^cends  the  chain  explaining  how  sub-goals  were  or 
could  be  achieved.  Figure  2-1  is  an  excerpt  of  a  consultation  in  which  the  program  is  explaining  its 
line  of  reasoning. 

42)  Does  Mary  11v«  In  a  crowdad  anvlronaantr 
••  tIHY 

[l.a.  WHY  la  It  laportant  to  dataralna  wliathar  PATlENT-1  doaa  llva  In  a 
crowdad  anvironawnt?] 

[3.0]  This  Mill  aid  In  dotoralnlng  tha  organlsas  (other  than  thosa  toon  on 
cultures  or  sanars)  Mhich  alght  bo  causing  tha  Infaction. 

It  has  already  bean  established  that 

[3.1]  the  Infection  which  requires  therapy  Is  aenlngltls,  and 

[3.2]  organlsas  were  not  teen  on  the  stain  of  tha  pending  csf  culture 

(CULTURE-1),  and 

[3.3]  tha  type  of  tha  Infection  Is  bacterial 
Therefore.  If 

[3.4]  Mary  does  live  In  a  croaded  anvIroniMnt 
then 

there  Is  weakly  suggestive  evidence  (.2)  that  Nelsserla-aanlngltldlt 
is  one  of  the  organlsas  (other  than  those  seen  on  cultures  or 
saears)  which  alght  be  causing  tha  Infection 
Author:  Yu 
[RULE033] 

[back  to  question  42...] 

••  SHY 

[I.e.  MHY  Is  It  laportant  to  deteralne  the  orgaalsan  (other  than  those  seen 
on  cultures  or  saears)  which  alght  be  causing  the  InfectlonT] 

[4.0]...  In  order  to  deteralne  the  therapeutic  regimen  of  PATIENT-l. 

If 

[4.1]  Inforaatlon  has  been  gathered  about  organlsas  Isolated  from 

this  patient,  organlsas  noted  on  saears  of  this  patient, 
negative  cultures  of  this  patient,  suspected  Infections 
without  microbiological  evidence,  current  drugs  of  this 
patient  and  prior  drugs  of  this  patient,  and 

[4.2]  an  attempt  has  been  made  to  deduct  the  organlsas  which  require 

therapy,  and 

[4.3]  you  have  given  consideration  to  organlsas  (other  than  those 

seen  In  cultures  or  saeers)  which  might  be  present 

then 

deteralne  the  best  therapy  recommendation  from  among  tha  drugs  likely 
to  be  effective  against  the  significant  organisms,  or  Indicate 
that  no  therapy  Is  required  at  this  time 
[RULE092] 

[back  to  question  42...] 

••  NO 


Figure  2-1 :  Sample  Mycin  Explanations 
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Here  the  current  question,  "Does  the  patient  live  in  a  crowded  environment?"  by  rule  533  would 
imply  "Is  Neisseria-meningitidis  causing  the  meningitis?".  This  explanation  is  a  good  example  of  the 
large  amount  of  information  embedded  in  the  rules.  The  clause  ordering  in  the  rule  implicitly  specifies 
a  strategy  of  top-down  refinement-the  system  is  to  determine  that  the  patient's  infection  is  meningitis 
before  trying  to  explore  the  possibility  of  bacterial  meningitis.  This  highlights  the  disease  hierarchy 
also  obviously  present  in  the  expert’s  model:  meningitis  (clause  1)  is  more  general  than  bacterial 
meningitis  (clause  3),  which  is  the  parent  of  neisseria-meningitides  (the  conclusion).  The  answer  to 
the  second  WHY  illustrates  one  of  MYCIN’s  "task  rules,”  used  to  direct  the  consultation  at  the  highest 
level.  Note  the  implicit  procedure,  perhaps  apparent  to  the  experienced  physician,  of  gathering  initial 
information,  obtaining  medical  history  and  physical  exam  information,  and  then  considering  lab  data. 

Although  this  is  a  very  flexible  mechanism  which  accurately  portrays  what  the  system  is  doing,  it 
has  several  limitations.  For  example,  in  Figure  2-1  Mycin  can  not  explain  why  it  establishes  that  the 
infection  is  meningitis  [3.1]  before  it  determines  if  the  meningitis  is  bacterial  [3.3].  As  indicated 
above,  a  strategy  of  top-down  refinement  of  diseases  is  being  followed.  Much  of  the  information  that 
went  into  writing  the  rules,  including  justification,  ordering,  and  planning,  is  either  lost  or  made 
implicit  and  thus  cannot  be  explained.  This  inexplicable  information  is,  in  essence,  a  large  part  of  the 
strategy  employed  to  do  the  diagnosis. 

2.3.  Design  criteria 

In  determining  what  NEOMYCIN  should  explain  and  how  it  should  be  explained,  we  used  several 
design  criteria: 

•  Explanations  should  not  presuppose  any  particular  user  population.  The  long-range  goal 
of  this  research  is  to  use  NEOMYCIN  as  the  foundation  of  a  teaching  system.  At  that 
point  the  strategic  explanations  developed  here  will  be  used  to  teach  the  strategy  to 
students  to  whom  it  might  be  unfamiliar.  Techniques  used  to  generate  explanations 

■  should  be  flexible  enough  to  accommodate  a  model  of  the  user. 

•  Explanations  should  be  informative;  rule  numbers  or  task  names  are  not  sufficient. 

•  Explanations  should  be  concrete  or  abstract,  depending  upon  the  situation.  Thus  it  must 
be  possible  to  produce  explanations  in  either  form.  This  should  facilitate  understanding 
both  of  the  strategy  and  how  it  is  actually  applied. 

•  Explanations  should  be  useful  for  the  designer,  as  well  as  the  end  user  of  NEOMYCIN. 

The  vocabularies  of  computer  science  and  an  application  domain,  such  as  medicine,  are 
different  in  many  ways.  People  tend  to  be  most  comfortable  with  the  vocabulary  of  their 
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field;  the  system  should  have  the  flexibility  to  accommodate  a  user-dependent  choice  of 
terminology. 

•  Explanations  should  be  possible  at  the  lowest  level  of  interest',  the  "grain  level"  should  be 
fine  enough  to  permit  this.  To  allow  for  use  in  debugging,  we  chose  the  level  of  rules  and 
tasks  as  our  lowest  level.  Higher  level  explanations  can  later  be  generated  by  omitting 
details  below  the  appropriate  level. 

The  following  explanation  of  strategy  is  an  example  of  how  we  try  to  satisfy  these  criteria  in 
NEOMYCIN.  Note  how  the  explanation  is  abstract,  more  similar  to  a  MYCIN  "task  rule"  (e.g.  rule  92  in 

figure  2-1)  than  a  domain  rule  (e.g.  rule  533). 

17)  Has  Mary  been  hospitalized  recently? 

••  MHY 

[I.e.  WHY  Is  It  Important  to  determine  whether  Mary 
has  been  hospitalized  recently?] 

[21.0]  We  are  trying  to  round  out  the  diagnostic 
Information  by  looking  generally  Into  past 
medical  history  and  by  reviewing  systems. 

There  are  unasked  general  questions  that  can  help  us 
with  the  diagnosis. 

3.  How  strategic  explanations  are  possible  -  the  NEOMYCIN 
system 

MYCIN  (Shortliffe,  1976),  the  precursor  of  NEOMYCIN,  is  unable  to  explain  its  strategy  because 
much  of  the  strategic  information  is  implicit  in  the  ordering  of  rule  clauses  (Clancey,  1983a).  In 
NEOMYCIN,  the  problem-solving  strategy  is  both  explicit  and  general.  This  section  provides  an 
overview  of  the  representation  of  this  strategy  in  NEOMYCIN,  since  this  is  the  basis  for  our  strategic 
explanations.  Other  aspects  of  the  system,  such  as  the  disease  taxonomy  and  other  structuring  of  the 
domain  knowledge,  are  described  in  (Clancey  &  Letsinger,  1981). 

NEOMYCIN'S  strategy  is  structured  in  terms  of  tasks,  which  correspond  to  metalevel  goals  and 
subgoals,  and  metalevel  rules  (metarules),  which  are  the  methods  for  achieving  these  goals.  The 
metarules  invoke  other  tasks,  ultimately  invoking  the  base-level  interpreter  to  pursue  domain  goals  or 
apply  domain  rules.  Figure  3-1  illustrates  a  portion  of  the  task  structure,  with  metarules  linking  the 
tasks.  The  entire  structure  currently  includes  30  tasks  and  74  metarules.  This  task  structure 
represents  a  general  diagnostic  problem-solving  method.  Although  our  base-level  for  development 
has  been  medicine,  none  of  the  tasks  or  metarules  mention  the  medical  domain.  As  a  result  the 
strategy  might  be  ported  to  other  domains.  (See  (Clancey,  1983b)  for  further  discussion.) 
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Figure  3-1 :  Invocation  of  tasks  in  the  example  NEOMYCIN  consultation 
Question  numbers  correspond  to  questions  asked  in  the  consultation, 
solid  lines  show  tasks  actually  done,  dotted  lines  those  which  might 
be  done.  Note  how  tasks  such  as  TEST -HYPOTHESIS  are  invoked 
multiple  times  by  a  given  task  as  well  as  by  different  tasks. 

An  ordered  collection  of  metarules  constitutes  a  procedure  for  achieving  a  task.  Each  metarule 
has  a  premise,  which  indicates  when  the  metarule  is  applicable,  and  an  action,  indicating  what  should 
be  done  whenever  the  premise  is  satisfied.  Figure  3-2  is  a  high-level  abstraction  of  a  task  and  its 
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metarules.  The  premise  looks  in  the  domain  knowledge  base  or  the  problem-solving  history  for 
findings  and  hypotheses  with  certain  properties,  for  example,  possible  follow-up  questions  for  a 
recent  finding  or  a  subtype  of  an  active  hypothesis.  Associated  actions  would  be  to  ask  the  user  a 
question  or  call  a  task  to  refine  the  hypothesis  under  consideration.  The  metarules  associated  with  a 
task  may  describe  the  sequence  of  steps  used  to  achieve  the  task  (in  which  case  the  applicable  rules 
are  applied  once  in  order),  or  may  present  alternate  strategies  for  achieving  the  goal  (in  which  case 
the  preferentially  ordered  rules  are  executed  until  the  goal  of  the  task  is  achieved). 


causal  and  taxonomic  about  a  domain  tasks 

relations  domain  rules 

goal 


Figure  3-2:  Abstraction  of  a  Task  and  its  Metarules 

Testing  an  hypothesis  is  just  one  reason  for  asking  a  question.  Others  are: 

•  Initial  identification  of  the  problem 

•  Follow-up  questions  to  specify  recent  information  in  greater  detail 

•  Questions  triggered  by  recent  data  that  suggested  an  hypothesis 

•  General  questions  to  determine  the  completeness  of  the  case  history 


•  Screening  questions  to  determine  the  relevance  of  desired  data 

•  Questions  asked  while  pursuing  subgoals  of  the  domain. 

The  number  of  reasons  for  asking  questions  testifies  to  the  complexity  of  NEOMYCIN’S  diagnostic 
strategy  and  illustrates  why  strategic  explanations  are  both  useful  and  interesting. 

4.  NEOMYCIN’S  strategic  explanations 

4.1 .  WHY  and  HOW  explanations 

Excerpts  from  a  NEOMYCIN  consultation  illustrate  the  strategic  explanation  capability  most  clearly. 
User  input  follows  the  double  asterisks  (*  *)  and  is  shown  in  capital  letters.  The  consultation  begins: 

Pleas*  enter  Information  about  the  patient. 

NaaM  As*  Sex  Race 

1)  ••  MARY  42  F  LATIMO 

Pleas*  describe  the  chief  complaints: 

*•  HEADACHE 
••  STIFF-NECK 
*•  NAUSEA 

•• 

2)  Hoe  many  day*  has  Mary's  headache  lastedf 

••  10 

3)  How  sever*  Is  Mary's  headache  (on  *  scat*  of  0  to  4 
with  0  for  very  mild  and  4  for  very  sever*)? 

••  WHY 

[1.*.  WHY  Is  It  Important  to  determine  the  severity  of 
Mary's  headacha?] 

[1.0]  W*  are  trying  to  characterize  the  data  Just 
obtained  and  develop  the  differential. 

Headache  severity  Is  a  characterizing  feature  of  headache. 

[back  to  question  3...] 

To  explain  WHY  something  is  being  done  by  NEOMYCIN,  we  first  restate  the  question  as,  "WHY  are 
we  trying  to  do  this  task?"  Because  each  task  is  invoked  by  a  metarule  in  another  task  (see  Figure 
3-2),  we  answer  the  query  by  stating  the  task  and  metarule  that  invoked  the  task  in  question.  At  the 
lowest  level,  there  are  implicit  tasks  of  requesting  data  and  applying  rules.  The  template  for  an  initial 
WHY  explanation  is: 


<r«qu«tt  for  dato> 

••  WHY 

[1.0.  MHY  1«  It  laportMt  to  dotoratno  <dato>r] 

[1.0]  <1aMd1«to1y  proeoding  t««k> 

<«bot  Is  truo  about  tho  doaaln  kaoulodgo  boat  or  tho 
probloa-tolving  blatory  that  aaabloa  tbo  aotarulo  that 
accoHpllshoa  this  task  to  suecood> 


In  this  case  the  current  metarule  is: 


MITAPULI07S 

If  tboro  Is  a  datwa  that  can  bo  raouastod  that  la  a 
ekaraetarlalag  faatura  of  tho  raeaat  fladlag 
that  la  eurroatly  balag  coaaldarad. 

THIN  flad  out  about  tho  datwa. 


We  mentioned  earlier  the  idea  of  providing  concrete  or  abstract  explanations  as  appropriate,  in  the 
context  of  a  diagnostic  consultation,  it  seems  reasonable  to  provide  concrete  explanations  when 
possible.  Abstract  explanations  can  always  be  produced,  however.  The  abstrsKt  explanation  in  this 
situation  is: 


••MSTIMCT 

[1.0.  MNV  la  It  teporiooi  to  dotoreloo  tho  aovorlty  of 

Hory'a  hoodochoT] 

[1.1]  Wo  aro  trylof  to  charactorlao  tho  dots  Just  obtalood 
ood  dovolop  tho  diff orootlol . 

A  datwa  that  cao  bo  roquostod  Is  a  eharoctorlilog  footuro 
of  tho  rocoot  flodlof  that  la  eurroatly  bolog 
eooaldorod. 


When  subsequent  WHVs  are  given,  we  ascend  tee  strategy  tree,  as  illustrated  below. 


[I.c.  NNY  tr*  M  trying  chtrsctnriM  th*  data  Just 
obtalaad  aad  dtvalop  tha  dlffaraatlalT] 


[1.0]  Ha  ara  trying  to  giva  thorough  consldaratlon 
to  any  meant  findings. 

Tha  fact  that  Nary  has  auffarad  froai  haadachas  racantly 
la  a  na«  finding,  ahleh  first  auat  ba  charactarliad 
and  than  usad  to  assist  tha  diagnosis. 

[back  to  guostlon  3...] 

••  HHY 

[1.0.  HHY  ara  «a  trying  giva  thorough  consldaratlon  to 
any  meant  findings?] 

[S.O]  Ha  ara  trying  to  gathor  Identifying  Informtion— 
tha  chief  eosgilalht  and  sMjor  problosM. 

Tha  user  auat  state  tha  problaai. 

[back  to  guostlon  3...] 


••  3 

OIFFERCHTIAL: 

(VIRUS  004)  (CNRONIC-MENIMITIS  423) 

Ouestions  4  and  14  below  are  both  asked  as  a  result  of  the  TEST-HYPOTHESIS  task.  Notice  how  the 
explanations  of  this  single  task  reflect  the  different  situations  of  the  two  WHY  questions.  Different 
metarules  apply-questlon  4  is  based  on  a  strong  "triggering”  relation,  while  question  14  is  based  on 
only  moderate  evidence. 


4)  Dm*  Mtry  b«v«  a  favarf 


••  WHY 

[l.a.  MNY  la  It  laportaat  to  datanilaa  ■hathar  Mary  baa 
a  favarT] 

[4.0]  Ma  ara  try lag  to  tfactda  vbatbar  Nary  baa  an 
Inf action. 

Favor  la  atrongly  aaaoclatad  «1tb  Inf action. 

[back  to  quaatlon  4...] 

••  YES 


14)  Dooa  Nary  bava  a  blatory  of  granuloaaa  on  biopay  of 
tba  llvar.  lya^b  noda.  or  otbar  organ? 

••  NHY 

[1.0.  WHY  la  It  laportant  to  datanalna  whathar  Nary  baa  a 
blatory  of  granuloma  on  biopay  of  tba  llvar,  1yaq>b 
noda.  or  otbar  organ?] 

[10.0]  Ha  ara  trying  to  daclda  Mbotbor  Nary  baa 
tubarculoala. 

A  blatory  of  granuloma  on  biopay  of  tba  llvar,  lyiapb  noda, 
or  otbar  organ  mkoa  tubarculoala  aora  llkaly. 

[back  to  quaatlon  14...] 


HOW  is  asked  in  terms  of  a  previously  mentioned  task.  The  explanation  presents  any  metarules 
associated  with  the  relevant  instance  of  the  task  that  have  been  completed,  as  well  as  the  one 
currently  being  executed.  As  a  result  of  the  structure  of  tasks  and  metarules,  the  WHY/HOW 
explanations  have  an  interesting  property.  A  WHY  explanation  essentially  states  the  premise  of  the 
metarule;  this  is  exactly  the  reason  the  metarule  succeeded.  A  HOW  explanation  is  a  statement  of  the 
action  of  a  metarule;  this  is  exactly  what  was  done. 


In  the  next  example,  we  are  asking  HOW  {^out  a  low-level  task.  Note  that  the  answer  is  at  the 
lowest  level  of  applying  rules. 


••  HOW  19.0 

[1.*.  HOW  arc  m  trying  to  daelda  whothnr  Nary  haa 
tubarculoalat] 

Wa  did  tha  following: 

[20.1]  Appllad  a  ruin  mntloning  a  causal  pracuraor  to 
tuboreuloals  (tb  risk  factor;  ru1a626),  and 

[20.2]  Gave  thorough  consideration  to  any  meant  findings. 

[20.3]  Applied  a  ruin  mentioning  ganoral  avidanea  for 
tuberculosis  (focal  neurological  signs;  rulaSOO).  and 

[20.4]  Gave  thorough  consideration  to  any  recent  findings. 

[20.6]  Applied  a  rule  mentioning  general  evidence  for 
tuberculosis  (compromised  host;  ruleSOO).  and 

[20.0]  Gave  thorough  consideration  to  any  recent  findings. 


[20.7]  Applying  a  rule  mentioning  general  evidence  for 
tuberculosis  (a  history  of  granulomas  on  biopsy  of 
the  liver,  lymph  node,  or  other  organ;  ru1e002). 

We  will  next: 

[20.8]  Give  thorough  consideration  to  any  recent  findings, 
[back  to  question  14...] 

••  NO 


The  HOW  question  below  refers  to  a  high  level  tasK  (ESTABLISH-HYPOTHESIS-SPACE)  mentioned  in 
the  omitted  sequence  of  WHY’s.  Notice  that  the  explanation  is  at  a  high  level  and  is  entirely  abstract 


IS 


17)  Nm  Mry  bMa  botpltal  lz«tf  raeMtIyf 

••  WJY 


••  NOW  U.O 

[1.«.  HOW  arc  m  trylag  ta  davalop  tha  diffaraatlal  ualag 
basic  blatary  aad  partlaaat  physical  axsaf] 

Ha  did  tba  fallaalag: 

[26.1]  6et  a  gaaarat  Idas  af  tba  problaa;  eatagorlsad  It 
lata  aaa  ef  savaral  patbafaalc  classas  ar  disaasa 
lad.  or  both. 

[26.2]  Coafiraad  aad  raflaad  tba  diffaraatlal  dlagaosls 
tbraagb  spacific  guastlaaa. 

Ha  ara  aaa: 

[26.2]  daaadlag  aat  tba  diagaastic  lafonaatlaa  by  laaklag 
gaaarally  lata  past  swdleal  bistary  aad  by  ravlaalag 
systaiM. 

[back  ta  gaaatlaa  17...] 

••  HO 


Besides  these  strate0ic  WHY's  and  HOWs,  the  user  can  ask  about  the  current  hypothesis,  the  set 
of  hypotheses  currently  being  considered,  and  evidence  for  hypotheses  at  the  domain  level. 


4.2.  Comparison  to  MYCIN 

NEOMYCIN  uaas  an  explanation  approach  aimHar  to  MYCIN’s,  that  of  explaining  its  actions  in  terms 
of  goals  and  rules,  so  a  brief  compariaon  of  the  two  systems  is  useful  (Figure  4-1). 

MVCIH  HIQHVCIB 

Sasic  raasaalag:  Sasic  raasaalag: 

gaal  ->  rala  *>  sabgaal  task  ->  eatarula  ->  subtask 

A  goal  Is  pursaad  ta  satisfy  A  task  is  pursuad  abaa 
tba  praalsa  af  a  dasMla  rala  axacutlag  tba  actlaa  af  a 
(backward  cbalalag)  eatarula  (forward  raasaalag 

with  rula  sats) 

To  axplala  why  a  goal  Is  To  axplala  way  a  task  Is 

pursuad,  cita  tba  daesla  rula  doaa,  elta  tba  eatarula  that 

that  usas  It  as  a  subgaal  lavokas  It  (actlaa) 

(prselsa) 

To  axplala  how  a  goal  Is  To  axplala  how  a  task  Is 

datarelaad,  cita  tba  rulas  accoepllshad.  cito  tha 

that  coactuda  It  awtarulas  that  achiava  It 

Figure  4*  1 :  Comparison  of  MYCIN  and  NEOMYCIN  Explanations 


The  structure  of  explanations  is  parallel,  except  that  in  MYCIN  rules  invoke  subgoals  through  their 


16 


premises,  while  NEOMYCIN  metarules  invoke  subtasks  through  their  actions.  In  fact,  NEOMYCIN'S 

rules,  which  are  in  the  format: 

If  <prm1t«> 

Th«n  Inwok*  aubtaik* 

could  be  rewritten  in  the  MYCIN  style  of: 

If  <prMi1a*> 

and  aubtaaka  don* 

Than  highar  taak  aehlavad. 

However,  we  have  no  specific  conclusion  to  make  about  the  higher  task,  so  the  actions  of  all 
metarules  for  a  given  task  would  be  identical.  Moreover,  the  subtasks  are  clearly  different  from  the 
database  look-up  operations  of  the  premise.  It  is  therefore  natural  to  view  the  subtasks  as  actions. 
What  makes  NEOMYCIN'S  explanations  qualitatively  different  from  MYCIN’s  is  that  they  are  generated 
at  the  level  of  general  strategies,  instantiated  with  domain  knowledge,  when  possible,  to  make  them 
concrete. 

4  3.  Integrating  metalevel  and  base-level  goals 
Our  attempts  to  provide  strategic  explanations  have  clarified  for  us  some  of  the  basic  differences 
between  metarules  and  domain  rules.  Originally,  we  thought  that  tasks  were  logically  equivalent  to 
domain  goals,  as  metarules  were  the  analog  of  domain  rules.  Specifically,  when  Neomycin  asked  a 
question,  we  thought  that  the  stack  of  operations  would  show  a  sequence  like  this: 

taski 
metarule  1 
task2 
metarule  2 


taskn 
metarule  n 
domain  goal  1 
domain  rule  1 
goal  2 

backward 
chained 
rules 

goal  m  ■  question  asked  of  the  user 

Under  this  goal- rule-goal  scheme,  WHY  questions  could  proceed  smoothly  from  the  domain  level  to 
the  metalevel.  But  in  fact,  metarules  sometimes  invoke  a  specific  domain  rule  directly,  so  the 
following  sequence  occurs: 
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taskn 
metarule  n 
domain  rule  1 
goal  1 


goal  m  s  question  asked  of  the  user 

In  this  case,  there  is  an  implicit  task  of  "apply  a  domain  rule"  (invoked  by  metarule  n).  Identifying  and 
explaining  implicit  tasks  like  this  is  what  we  mean  by  the  problem  of  integrating  metalevel  and  base- 
level  goals.  In  MYCIN,  when  Davis  (Davis,  1976)  cites  the  domain  rule  being  applied,  he  is  skipping 
the  immediate  intervening  metalevel  rationale:  "We’re  asking  a  question  to  achieve  the  goal  because 
we  were  unable  to  figure  out  the  answer  from  rules,"  or  "For  this  goal,  we  always  ask  the  user  before 
trying  rules."  In  a  more  recent  version  of  NEOMYCIN,  we  do  make  this  rationale  explicit;  however  this 
is  uninformative  for  most  users,  and  the  explanation  should  properly  proceed  to  higher  tasks. 

4.4.  Implementation  issues 

We  mentioned  earlier  that  NEOMYCIN  was  designed  with  the  intent  of  guiding  a  consultation  with  a 
general  diagnostic  strategy.  A  given  task  and  associated  metarules  may  be  applied  several  times  in 
different  contexts  in  the  course  of  the  consultation,  for  example,  testing  several  hypotheses.  To 
produce  concrete  explanations,  we  keep  records  whenever  a  task  is  called  or  a  metarule  succeeds; 
this  is  sometimes  called  an  audit  trail.  Data  such  as  the  focus  of  the  task  (e.g.,  the  hypothesis  being 
tested)  and  the  metarule  that  called  it  are  saved  for  tasks.  Metarules  that  succeed  are  linked  with  any 
additional  variables  they  manipulate,  as  well  as  any  information  that  was  obtained  as  an  immediate 
result  of  their  execution,  such  as  questions  that  were  asked  and  their  answers.  When  an  explanation 
of  any  of  these  is  requested,  the  general  translations  are  instantiated  with  this  historical  information. 

Rgure  4-2  presents  several  metarules  for  the  TEST-HYPOTHESIS  task  translated  abstractly.  A 
sample  of  the  audit  trail  created  in  the  course  of  a  consultation  is  shown  in  Rgure  4-3;  this  is  a 
snapshot  of  the  TEST- HYPOTHESIS  task  after  question  14  in  the  consultation  excerpt.  An  example  of 
how  the  general  translations  thus  relate  to  the  context  of  the  consultation  can  be  seen  in  the  differing 
explanations  for  questions  4  and  14,  both  asked  because  an  hypothesis  was  being  tested. 

In  order  to  generate  explanations  using  an  appropriate  vocabulary  for  the  user,  we've  identified 
general  words  and  phrases  used  in  the  translations  that  have  parallels  in  the  vocabulary  of  the 
domain.  At  the  start  of  a  consultation,  the  user  identifies  himself  as  either  a  "domain"  or  "system" 


HETARULE411 

IF  Tl|«  datua  Is  question  Is  strongly  associated  with  the 
currant  focus 

THEN  Apply  the  related  list  of  rules 

Trans:  ((VAR  ASK1N6PARM)  (OOMAINVORO  "triggers”)  (VAR  CURFOCUS)) 
METARULEaCd 

IF  The  datun  In  question  aakes  the  current  focus  aora  likely 
THEN  Apply  the  related  list  of  rules 

Trans:  ((VAR  ASKINGPARM)  "Bakes”  (VAR  CURFOCUS)  "aore  likely") 

Figure  4-2:  Sample  NEOMYCIN  Metarules  for  the 
TEST-HYPOTHESIS  task 


STATIC  PROPERTIES 

TRANS:  ((VERB  decide)  whether  •  has  (VAR  CURFOCUS)) 

TASK-TYPE  :  ITERATIVE 
TASK60AL  :  EXPLORED 
FOCUS  :  CURFOCUS 
LOCALVARS  :  (RULELST) 

CALLEO-RY  :  (METARULE393  METARULE400  METARULE171) 

TASK-PARENTS  :  (6R0UP-AN0-0IFFERENTIATE  PURSUE-HYPOTHESIS) 
TASK-CHILOREN  :  (PROCESS-OATA) 

ACHIEVED-BY  :  (METARULE411  NETARULE66B  METARULE603) 

DO-AFTER  :  (METARULE332) 

AUDIT  TRAIL 

FOCUS-PARM  :  (INFECTIOUS-PROCESS  MENINGITIS  VIRUS 

CHRONIC-MENINGITIS  NYCOBACTERIUM-TB) 

CALLER  :  (METARULE393  METARULE400  METARULE171  METARULE171 
METARULE171) 

HISTORY  :  C(METARULE411  ((RULELST  RULE423) 

(QUES  4  FEBRILE  PATIENT-1  RULE423))) 
(NETARULE411  ((RULELST  RULE060) 

(QUES  7  CONVULSIONS  PATIENT-1 
RULEOeO})) 


(METARULE6BB  ((RULELST  RULE626) 

(QUES  11  TBRISK  PATIENT-1  RULE626)) 
NETARULE603 
((RULELST  RULE360) 

(QUES  12  FOCALSIGNS  PATIENT-1  RULESBB)) 
METARULE603 
((RULELST  RULE309} 

(QUES  13  COMPROMISED  PATIENT-1  RULE309)) 
METARULEBOa 
((RULELST  RULE002) 

(QUES  14  6RANUL0MA-HX  PATIENT-1  RULE002] 

Figure  4-3:  Sample  Task  Properties 


expert.  Whenever  a  marked  phrase  is  encountered  while  explaining  the  strategy,  the  corresponding 
domain  phrase  is  substituted  for  the  medical  expert.  For  example,  "triggers"  is  replaced  by  "is 
strongly  associated  with"  for  the  domain  expert. 


5.  Lessons  and  future  work 

The  implementation  of  NEOMYCIN’S  explanation  system  has  shown  us  several  things.  We've  found 
that  for  a  program  to  articulate  general  principles,  strategies  should  be  represented  explicitly  and 
abstractly.  They  are  made  explicit  by  means  of  a  representation  in  which  the  control  knowledge  is 
explicit,  that  is,  not  embedded  or  implicit  in  the  domain  knowledge,  such  as  in  rule  clause  ordering.  In 
NEOMYCIN  this  is  done  by  using  metarules,  an  approach  first  suggested  by  Davis  (Davis,  1976).  The 
strategies  are  made  abstract  by  making  metarules  and  tasks  domain-independent.  We've  seen  that  it 
is  possible  to  direct  a  consultation  using  this  general  problem-solving  approach  and  that  resulting 
explanations  are,  in  fact,  able  to  convey  this  strategy.  As  far  as  the  utility  of  explanations  of  strategy, 
trials  show  that,  as  one  might  expect,  an  understanding  of  domain  level  concepts  is  an  important 
prerequisite  to  appreciating  strategic  explanations. 

In  regard  to  representation  issues,  we’ve  found. that  if  control  is  to  be  assumed  by  the  tasks  and 
metarules,  all  control  must  be  encoded  in  this  way.  implicit  actions  in  functions  or  hidden  chaining  in 
domain  level  rules  lead  to  situations  which  do  not  fit  into  the  overall  task  structure  and  cannot  be 
adequately  explained.  This  discovery  recently  encouraged  us  to  implement  two  low-level  functions  as 
tasks  and  metarules,  namely  MYCIN’s  functions  for  acquiring  new  data  and  for  applying  rules.  Not 
only  do  the  resulting  explanations  reflect  more  accurately  the  actual  activities  of  the  system,  they’re 
also  able  to  convey  the  purpose  behind  these  actions  more  clearly. 

There  is  still  much  that  can  be  done  with  NEOMYCIN’S  strategic  explanations.  We  mentioned  that 
our  current  level  of  detail  includes  every  task  and  metarule.  We'd  like  to  develop  discourse  rules  for 
determining  a  reasonable  level  of  detail  for  a  given  user.  We  also  plan  to  experiment  with 
summarization,  identifying  the  key  aspects  of  a  segment  of  a  consultation  or  the  entire  session.  We 
might  also  explain  why  a  metarule  failed,  why  metarules  are  ordered  in  a  particular  way,  and  the 
justifications  for  the  metarules.  An  advantage  of  our  abstract  representation  of  the  problem-solving 
structure  is  that  when  the  same  procedure  is  applied  in  different  situations,  the  system  is  able  to 
recognize  this  fact.  This  gives  us  the  capability  to  produce  explanations  by  analogy,  another  area  for 
future  research. 
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Haablaccoa.  K  20200 

I  Dr.  Artbat  HalaaO 
724  SrewD 

0.  S.  Dope,  of  Uueatloa 
VaBblaftea,  DC  20200 

1  Dr.  AaOraw  X,  Malaat 
Of flea  af  Sclaatlfle  and  Cailaatrlao 
PariOBDol  aad  Edaeatloa 
Matlaaal  Setaaev  Fwaiiiaclon 
Waabloocea,  DC  20)30 

1  Or.  Oaaratt  Palaar 
lull  liip  2)0>) 

NASA-Aaaa  laaaareh  Caatar 
Heffaet  Piill,  (U  0i)» 

1  Dr.  Mary  Scaddacd 
e  19,  Mail  Step  0204 
Laa  Alaaaa  Matlaaal  laboratartaa 
lot  Alaaaa,  07)4) 

1  Cblaf,  Payebelatteal  laaareb  Otaacb 
0.  S.  Caaat  Ouard  (e-P>l/2/IP42} 
Waaktaoton.  DC  20)0) 

I  Dr.  Idward  C.  Vataa 
Nactaoal  Sclaaea  Paaadatlati 
1099  0  Straat,  W 
Vaahlagtaa,  DC  20))0 


I  Dr.  traak  Oltbraw 
0.  S.  Offlea  af  tducactaa 
400  Harylaad  A«a.  SO 
VaaklHCao,  DC  29202 

1  Or.  Jaaaph  L.  2a<wo.  Dlraetac 
Maaary  A  Cagaltlaa  Procaoaaa 
latlaaal  Selaaca  Paaadatloa 
Oaahlactaa.  DC  20))0 


Prlaaca  Saetar 

I  Or.  Jaha  1.  Aaiaraaa 
Dapartaaat  af  Paychalafy 
Caraatlo-Mallaa  Oaiaaralcy 
Plttabarfb.  PA  1)21) 

1  Or.  Patricia  lafgatt 
Dapariaaac  af  Payctolva'y 
Oaiaaralcy  af  Calarado 
Saaldar.  CO  00)OS 

1  Mr.  Aaroa  larr 
Dapartaaat  af  Caapetar  Sclaaea 
SeWard  Oaiaaralcy 
Staaferd.  Ca  *4)0) 

1  Or.  Maaueba  Dlraabaua 
Sebaal  af  tdoeaclaa 
fal  Aala  Oaiaaralcy 
Tal  Aala,  laaat  Aala  4**70 
laraal 

1  Or.  Joba  Black 
tala  Oaiaaralcy 
On  IIA,  Tala  Statlaa 
Oaw  Baaaa,  CT  04)20 

1  Dr.  Jaka  S.  Braaa 
xnoz  Palo  Alto  BaaaartH  Cav.*: 
j1))  Cayaca  Baad 
Pala  Alta,  a  *4)04 

1  Or,  eiaaa  Bryaa 
4200  Paa  Baad 
Bacbaada,  KD  20017 

I  Dr.  Jalaa  Carbaoall 
CaxBaoia'MalloB  Oalaaralty 
Dapartaaat  of  Payebelegy 
Plttabarsb,  PA  1)21) 

1  Dr.  Pat  CariMatar 

Dapartaaat  of  Nyebelofy 
CataaflcHtallaa  Oalraralty 
Plttabarsb,  PA  1)21) 

1  Dr.  Wtlliaa  Cbaac 
Dapartaaat  of  Payebolcsy 
Cacaaglc  Halloa  Oalrartlty 
Plttabargb,  PA  1)213 


1  Or.  meballaa  Cbl 
laaraiag  BAD  Caatar 
Oaiaaralcy  af  Plttabargb 
)*)«  O'Mara  Straat 
ntctb<^h,  PA  1)21  X 

1  Mr.  nicfeaal  Cola 
Oaiaaralcy  of  CallfaraU 

at  Sa>  Stage 

Uborataiy  af  Caaparaclaa 
Ommi  eegattlaa  >  000)4 
U  JaUa,  CB  *20*3 

1  Or.  Bllaa  H.  Calllaa 

Balt  Baraaafc  A  Maaaaa,  lac. 
)0  Maalcaa  Straat 
CBbrldga.  MA  021)0 


1  Dr.  Lyaa  A.  Caapar 
UUK 

Oaiaaralcy  of  Ptccaburgb 
1*1*  O'&ara  Stcaa: 

Pltttburgb,  PA  1)21) 

1  aiC  Paellley-Acialrlclana 
40)1  Bugby  Aaaauc 
Batbaada.  *0  29)14 

1  prafaaaor  Bauaaa  Pauaratal'i 
SOCBl  Baboa  Baraaa  A 

Oat  Bakaraa 

JaraaalM 

laraal 

1  Nr.  VaUaca  Paaraclg 
Dapartaaat  of  tdueaclaaal  Taebnalogy 
Bolt  Baraaak  4  Mawaa 
10  Maalcaa  St. 

Caabrldga.  MA  022)0 

1  Dr.  Daxecr  Flatebar 
WICAT  BaaaarcH  laatltata 
107)  S.  Stata  St. 

Ocaa.  R  223)1 

1  Dr.  Jeba  B.  Pradarlkaao 
Salt  Baraaak  A  Nawaaa 
)9  M-nlcaa  Straat 
Caabrldga,  HA  921)0 


Caatar  for  Baaa  lafecaatten  Pracaaclag 
Oaiaaralcy  of  Callforala,  Saa  Mega 
U  Jolla.  CA  *20*3 

1  Dr.  Dadrc  Caataar 
Balt  Baraaak  A  Nawaaa 
19  Naultaa  St. 

Cnbrldga,  MA  021)0 

1  Or.  Bakart  Claaar 

laaralng  Kaaaareb  A  Davalapaaat  Caatar 
Oalwatalty  of  Plttabargb 
JP)P  O'Oara  Straat 
PlITSBOBSO.  PA  13240 

1  Dr.  Htrvia  0.  Clack 
217  Stone  Ball 
Ceraall  Unlvaratcy 
Ithaca,  NT  14BS) 

1  Dr,  Joapb  Cagwaa 
$B1  lacaraatlaaal 
)))  Bavanawaed  Araaaa 
Haalo  Park,  CA  *4023 

1  Dr.  Daalal  Gopbar 

Paealcy  af  ladoacrlal  toglaaartag 
4  Naaagaaaac 
TBCONION 
Balfa  32000 
ISBAEL 

1  DB.  JAKES  C.  CBSZ.M9 
tanr 

OHimsin  or  pirisBOECo 

)*)*  O'SAIA  STBSrr 

pimsoisi.  PA  1)211 

I  Dr.  Barbara  ■ayaa*Batb 
Oapartaaac  of  Coapattr  Sclaaea 
SttaiarB  Oalwaralty 
Staaford.  CA  *3)03 

1  Dr.  Earl  Daat 
Dapt.  af  Payebaltiy 
Onlaaraicy  af  Uaablagtaa 
Eaattla,  VA  *110) 

I  Or.  Narcal  Jatt 
Dapartaaat  af  payebalafy 
CaraaElfHallaa  Oalwaralty 
rittabarfk,  PA  1)21) 


I  ftr.  U*(M 

0**arM«i(  •!  t«rs'wlji7 
•!  Art  MM 

tmm*.  tf  um 

1  M*  VatMr  UatMh 
MMrta— 1  af  r*7«kal«(7 
«Bt*M*t«y  •t  CatwM* 

•mu**.  go  WM> 

1  »r.  ScaThaa  Iaa*l7a> 
tlM  Oimaa  jMaa  taU 
3)  UlUait  SC. 

CaChrlGta,  SA  9113t 

t  Or.  fat  laaftar 
Ska  Bakactea  laactcaca 

Canacltr>-tillaa  Mlaarsler 
rittakttcsh.  FA  13113 

I  Or.  Jill  Urkta 
OaFartaaat  af  FaTeSalagr 
Caraatta  Mallaa  OBlvariltf 
Ftccaharsk.  FA  13113 

1  Or.  Alaa  lassalA 
taaralag  SAD  Cantar 
0alvaratC7  af  FtccsSarfb 
3f3S  O’Hara  Straar 
FtccaWrgS,  FA  131M 

1  Or.  3ia  1.c*la 
OalaaraltF  af  Callfaimla 

at  Saa  Oiata 

Lakaracarf  tot  CoaFaraelva 
Siaaa  Cagattlon  -  9M3A 
U  Jalla.  CA  SlOU 

I  Or.  Mehaal  tarlaa 

OasartaaBC  af  tditsacloaal  FaFChalogj 
110  SAacaclaa  SlAg. 

OalvarattF  af  IlUaala 
Chaasalga.  XL  AllOt 

I  Or.  Rarela  b.  Uaa 
laaraaea  Sail  af  Sciaaea 
Oataacatcx  af  Callfarala 
BarkaXar.  CA  tA710 

1  Or.  Oaa  Lfaa 

trmJm  (osox) 

VUllMa  ATS.  A1  33113 

1  Or.  Jay  NeClallaaf 

Oasartaaat  af  Faxehalofv 
KXr 

Caakrtlga,  !tt  0113*' 


1  Or.  Jaaaa  S.  HiUac 

CoasacamhauBhc  Carsarattaa 
1711  Hast  Flaaa  SigSMay 
FXaaa.  tX  33073 

1  Or.  Hark  Millar 
eaaFaMr*Thaugbc  CarFSTaclan 
17X1  Maat  Flaaa  FattafaF 
Flaaa..  IX  73073 

1  Sr.  Taa  Maras 
Xaraa  FABC 

3331  CSTata  till  Ssa4 
Sals  Alta,  CA  «A30A 

I  Or.  Allas  Uars 
Sahavlsral  TaeSaalagr  Vakaractrlii 
1143  Blaaa  A*a..  Fsarth  Flssr 
lalaafa  Saatb,  CA  30177 

I  Or.  DsaaU  A  Saraaa 
Csgaltlaa  Salaaca.  €'413 
Oat*,  at  Callfstala,  Saa  Olaga 
U  Jalla.  CA  32033 


1  Or.  Jaaaa  Orlaat'cy 
laacttaca  fat  OafaMa  Aaalraaa 
1101  S.  SaauragarA  gc. 

AlaaaaArta.  fA  23311 

I  Frol.  SaTBOwt  Fafort 
20C-13f 

Nasaachaaaeta  laatltaca  of  TochaalogF 
CaabclAgo,  MA  02133 

1  Or.  Saacy  Faaalagtoa 
OalvaraltF  Of  ektcago 

CtoAaata  ScFaal  af  Saatasao 

1101  t.  SSth  tc. 

Chtcaga,  XL  40417 

1  ot.  rtm  Fouos 
ocrr.  OF  FsteoDvoGY 
ostsasm  of  ooiotAOO 
smogs,  00  10103 

1  Or.  Fra4  Utf 
Fliralca  DasariMac 
OatoaraltF  af  Calltarala 
Sarkalay,  CA  34720 

1  Or.  Lsoraa  Saastek 
LSDC 

OatoaraltF  af  FltcaAorgh 
3333  O’Bara  Scraat 
Fltubatsk.  FA  1321 . 

1  Or.  Jaff  Rleharlaaa  ; 

Oaaoar  BasaarcA  laatlcata 
OaloataltF  af  Oaaoar 
Oaaoar,  00  10201 

1  Hary  B.  Sllay 
Frograa  la  Cagattlos  Setaaea 
Castor  far  Buaaa  Xafotattloa  'rotMoiag 
OatoaraltF  af  CAllfsrata.  Saa  Otago 
U  Jolla,  CA  32033 

1  Or.  Aatraw  H.  toaa 
Aaortcaa  lastitotos  far  Satoarck 
1033  Tkartas  Jaffarssa  gc.  SSf 
HsoUa«ca«.  Oe  20007 

1  Dr.  trast  Z.  Ssthkaff 
tall  Labarstorlas 
HarraF  HtU.  W  07074 

I  Or.  Vtlllaai  t.  tsaoa 
Gaargla  Xasstcaca  of  TadaalogF 
ScAsat  af  loAaacrtal  4  SFatoas 
XagtBaartag 
AUaats.  CA  30332 

1  Or.  Oaol.!  Motalhart 
Caatar  iar  Htaia  XnfaraacSoa  Fraeaaalag 
Oslo,  af  Csltfomla,  Stn  ktaja 
U  Jal-la.  CA  32033 

1  Or.  Mtkaal  J.  SaaaC 
FareoFcraalea,  Xae 
4271  Vsrtal  Aoaaaa 
Hssflaa*  Btlla.  CA  31344 

1  Or.  Sagar  Schsak 
Tala  CaloaraltF 
OaFamaas  af  Coasatar  Salaaca 
F.O.  Baa  2131 
Baa  Bsoaa.  CT  04320 

1  Or.  ValCar  tckastlar 
FtFchslagF  Oasartaast 
403  X.  Bulal 
Ckaasatfa,  XL  SIBIO 

1  Dr.  Alaa  SckaasfaM 
Markaasttaa  sat  Uaeactoa 
Tko  Oatooralcy  of  Satsoatar 
BasAaitar,  ST  14417 


1  Hr.  Cslla  SboFFart 
AFFltal  Ftrehology  Oalt 
Atetrllty  Harlao  Toehaology  Sot. 
ta4«Uttoa.  Hlddlooaa 
Datcot  llAgtos 

1  Dr.  B.  Hallaeo  Staatks 
Frograa  Dlraccsr 

Haassvar  Saaoareb  sal  AlolMry  Sototcaa 
Satcbsoatas  lootltucton 
•01  Sortb  Flee  Scrooc 
AlaaoadrU.  TA  22314 

1  Dr.  glwarl  t.  Salrh 
talc  Sorsaak  4  So-Jaaa.  Int. 

30  Hsulcaa  Scraat 
CakkrtAgo,  HA  02131 

1  Or.  Sltatr4  gno« 

Sctosl  of  Etueatloa 
Scaafart  OatoaraltF 
Scaafsrl,  U  34303 

1  Dr.  gltocc  SslowaF 
Tala  OatoaraltF 
Oasartaaat  af  CaaFUCor  Sstoseo 
F.O.  Saa  113t 
Baa  Baoaa,  Ct  04323 

1  Or.  gAtbrya  T.  Ssaabr 
FayebalstF  OsFAresaat 
Sraoa  OatoaratCF 
Fraoitaaca,  tl  02312 

1  Or.  Ubort  Statakarg 
Oast,  af  rayekolHT 

Tala  OatoaraltF 
Sat  llA,  Tala  Scatlaa 
Sa»  Stoaa,  CT  04323 

1  Or.  Alkorc  Staoana 
Salt  laraaot  A  Hooaaa.  Xae. 

19  Havltaa  St. 

CaakrUgo,  HA  0223S 

I  OaoU  S.  StoM,  Fb.O. 
taasltlaa  CscFatatloa 
74«9  OU  SFrlagbaaao  load 
HeUta,  TA  21102 


1  Dr,  Sllaiat  Tstsuaks 
Carry  rear  Baaof  Xlatstlaa  Saaoareb  Lab 
232  Caglsaorlng  Saaasreb  Lsbaratary 
Orhsaa,  XL  tlSOl 

I  Dr.  FarrF  TharadFka 
FarcaFcroatea.  Xac.. 

343  M1441aflaU  Saad.  SaiCa  140 
Msala  Fark,  CA  340X3 

1  Dr.  Osaglas  Tsaaa 
Oalo.  af  Ba,  Callfarala 
Bahsotaral  Tsehaalagy  Labs 
ms  S.  Blasa  Aoa. 

Sadsaga  Saaeh,  CA  00177 

X  Or.  brt  Taa  taha 
Xsras  YAXC 

3333  Cayaca  Bill  tsad 
FUa  Alta,  CA  34304 

I  Dr.  Balth  T,  Haseeart 
FareoFtrsnlea,  Ine. 

343  Ittddlaflald  Asad,  Suita  140 
Maala  Fark,  CA  34023 

1  HlUlaa  0.  Hblctas 

ball  Labsraesrlas 

20-410 

Uladal,  HJ  07733 


1  Vr.  Ihoua  WIcIum 

•!  >sy«kDl«tj 

Frau  lall 

M««tatt>  •!  Caltfania 

*01  lUgarda  Avasaa 
tea  Aag*l**>  OA  fOOZA 

1  Ot.  Ntha  VtlltaB# 

■alt  iaraaak  A  Vavam 
10  Maaltaa  Sc. 

.  Caakrldga,  MA  0*904 

t  Oc.  Jaaagh  ViU 
Alshacach,  Xas. 

1  >acltaccaa  bae«ct«a  Caatar 
111  IliAAlaaaa  braftka 
Sacllagtaa.  MA  01009 


v.v.v.v 


